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1 Introduction 

In this work we are interested by the asymptotic study of non-regular para- 
metric statistical models encountered in statistical inference for stochastic 
processes. An exhaustive exposition of the parameter estimation theory in 
both regular and non-regular cases is given in the classical book [15j by Ibrag- 
imov and Khasminskii. They have developed a general theory of estimation 
based on the analysis of renormalized likelihood ratio. Their approach con- 
sists in proving first that the renormalized likelihood ratio (with a properly 
chosen renormalization rate) weekly converges to some non-degenerate limit: 
the limiting likelihood ratio process. Thereafter, the properties of the es- 
timators (namely their rate of convergence and limiting distributions) are 
deduced. Finally, based on the estimators, one can also construct confidence 
intervals, tests, and so on. Note that this approach also provides the conver- 
gence of moments, allowing one to deduce equally the asymptotics of some 
statistically important quantities, such as the mean squared errors of the 
estimators. 

It is well known that in the regular case the limiting likelihood ratio is 
given by the LAN property and is the same for different models (the renor- 
malization rate being usually l/\/n). So, the classical estimators — the 
maximum likelihood estimator and the Bayesian estimators — are consis- 
tent, asymptotically normal (usually with rate l/^Jn) and asymptotically 
efficient. 

In non-regular cases the situation essentially changes: the renormalization 
rate is usually better (for example, 1/n in change-point type models), but the 
limiting likelihood ratio can be different in different models. So, the classical 
estimators are still consistent, but may have different limiting distributions 
(though with a better rate) and, in general, only the Bayesian estimators are 
asymptotically efficient. 

In [7] a relation between two different limiting likelihood ratios arising 
in change-point type models was established by one of the authors. More 
precisely, it was shown that the first one, which is an exponential functional of 
a two-sided Poisson process driven by some parameter, can be approximated 
(for sufficiently small values of the parameter) by the second one, defined 

by 

Zq{x) = exp I W{x) - - |a;| i , x e R, (1) 

where W^ is a standard two-sided Brownian motion. In this paper we consider 
yet another limiting likelihood ratio process arising in change-point type 
models and show that it is related to Zq in a similar way. 



(3) 



The process Z^j 

We introduce the random process Z^j on R as the exponent of a two-sided 
compound Poisson process given by 

[ELt^ln^, ifx^O, 
lnZ,,^(a;) = <^ '' "' (2) 

yi^k=i in /(,-) > II a; ^u, 

where 7 > 0, / is a strictly positive density of some random variable e with 
mean and variance 1, 11+ and n_ are two independent Poisson processes 
of intensity 1 on IR+, e^. are independent random variables with density / 
which are also independent of n±, and we use the convention X]a;=i ^k = 0. 
We equally introduce the random variables 

^ j^xZ^j{x) dx 
^'^ /r Z^ji^) dx ' 
Cf = inf\z: Z^j{z) = supZ^j(a;)l, 

^+ =sup\z : Z. j{z) = supZ^j(x) I, 

e^,^ = ae~/ + (i-«)e+/, «e[o,i], 

related to this process, as well as their second moments B^ f = E(^^ r and 

An important particular case of this process is the one where the density 
/ is Gaussian, that is, e ~ A/'(0, 1). In this case we will omit the index / and 
write Z^ instead of Z^j, ^^ instead of C,^j, and so on. Note that since 

the process Z^ is symmetric and has Gaussian jumps. 

The process Z^j, up to a linear time change, arises in some non-regular, 
namely change-point type, statistical models as the limiting likelihood ratio 
process, and the variables C7,/ and ^" r as the limiting distributions of the 
Bayesian estimators and of the appropriately chosen maximum likelihood 
estimator, respectively. The maximum likelihood estimator being not unique 
in the underlying models, the appropriate choice here is a linear combination 
with weights a and 1 — a of its minimal and maximal values. Moreover, the 
quantities B^^j and M?' r are the limiting mean squared errors (sometimes also 



called limiting variances) of these estimators and, the Bayesian estimators 
being asymptotically efficient, the ratio E^j = Bjj/M!^j is the asjTiiptotic 
relative efficiency of this maximum likelihood estimator. 

The examples include the two-phase regression model and the threshold 
autoregressive (TAR) model. The linear case of the former was studied by 
Koul and Qian in [TB], while the non-linear one was investigated by Ciu- 
perca in [6]. Concerning the TAR model, the ffist results were obtained by 
K.S. Chan in [1], while a more recent study was performed by N.H. Chan and 
Kutoyants in |5] . Note however, that the estimator studied in [3] is the least 
squares estimator (which is, in the Gaussian case, equivalent to the maximum 
likelihood estimator), while the model considered in |5j is the Gaussian TAR 
model. So, only the processes Z^ are known to arise as limiting likelihood 
ratios in the TAR model. Note also that in both models, the parameter 7 of 
the limiting likelihood ratio is related to the jump size of the model. 

The process Zq 

On the other hand, many change-point type statistical models encountered 
in various fields of statistical inference for stochastic processes rather have 
as limiting likelihood ratio process, up to a linear time change, the process 
Zq defined by ([T]). In this case, the limiting distributions of the Bayesian 
estimators and of the maximum likelihood estimator are given by 

Lx Zq{x) dx 
Co = r V / N -J ^"^^ ^0 = argsupZo(a;), (4) 

Jj^ Zq{x) dx xGR 

respectively, while the limiting mean squared errors of these estimators are 
Bq = YiQ and Mq = E^q. The Bayesian estimators are still asymptotically 
efficient, and the asymptotic relative efficiency of the maximum likelihood 
estimator is Eq = Bq/Mq. 

A well-known example is the model of a discontinuous signal in a white 
Gaussian noise exhaustively studied by Ibragimov and Khasminskii in J14j 
and [T5|, Chapter 7.2], but one can also cite change-point type models of 
dynamical systems with small noise considered by Kutoyants in [IB] and [ T^ 
Chapter 5], those of ergodic diffusion processes examined by Kutoyants in 
[20l Chapter 3], a change-point type model of delay equations analyzed by 
Kiichler and Kutoyants in [17], a model of a discontinuous periodic signal 
in a time inhomogeneous diffusion investigated by Hopfner and Kutoyants 
in [131, and so on. 

Let us also note that Terent'yev in [22j determined the Laplace trans- 
form of P(|^o| > i) and calculated the constant Mq = 26. Moreover, the 



explicit expression of the density of ^o was later successively provided by 
Bhattacharya and Brockwell in [2j, by Yao in [23] and by Fujii in [TU]. Re- 
garding the constant Bq, Ibragimov and Khasminskii in [15l Chapter 7.3] 
showed by means of numerical simulation that Bq = 19.5 ± 0.5, and so 
£^0 = 0.73 ± 0.03. Later in [12], Golubev expressed Bq in terms of the sec- 
ond derivative (with respect to a parameter) of an improper integral of a 
composite function of modified Hankel and Bessel functions. Finally in [2T] , 
Rubin and Song obtained the exact values Bq = 16^(3) and Eq = 8C(3)/13, 
where ( is Riemann's zeta function defined by C(s) = X]^i 1/"^*- 

The results of the present paper 

In this paper we establish that the limiting likelihood ratio processes Z^j 
and Zq are related. More precisely, under some regularity assumptions on /, 
we show that as 7 — )■ 0, the process Z^j{y/I'y'^), y E R, (where / is the Fisher 
information related to /) converges weakly in the space Po(— C)0,+oo) (the 
Skorohod space of functions on IR without discontinuities of the second kind 
and vanishing at infinity) to the process Zq. Hence, the random variables 
I'-y^C^j and Ij'^^^j converge weakly to the random variables Co and ^o, respec- 
tively. We show equally that the convergence of moments of these random 
variables holds and so, in particular, Pj'^B^j — )• 16^(3), P-^^M^j — )■ 26 
and E'^j — )■ 8C(3)/13. Besides their theoretical interest, these results have 
also some practical implications. For example, they allow to construct tests 
and confidence intervals on the base of the distributions of Co and ^0 (rather 
than on the base of those of C7,/ and ^"j, which depend on the density / and 
are not known explicitly) in models having the process Z^j with a small 7 
as a limiting likelihood ratio. Also, the limiting mean squared errors of the 
estimators and the asymptotic relative efficiency of the maximum likelihood 
estimator can be approximated as 

o ^16C(3) ^ 26 ^8C(3) 

^7,/ ~ -J^T ' ^7,/ ~ j2y ^^^ ^7,/ ~ -^^ 

in such models. 

These are the main results of the present paper, and they are presented 
in Section [21 where we also briefly discuss the second possible asymptotics 
7 -T- +00 and present some numerical simulations of the quantities -B^, M° 
and E'^ for 7 G ]0, oo[. Finally, the proofs of the necessary lemmas are carried 
out in Section [31 

Concluding the introduction let us note that a preliminary exposition (in 
the particular Gaussian case) of the results of the present paper can be found 
in [H] and [9]. 



2 Asymptotics of Z^j 



Let 7 > 0, and let / be a strictly positive density of some random variable e 
with mean and variance 1. 



Regularity assumptions 

We will always suppose that ^/J is continuously differentiable in L^, that is, 
there exists ip E L'^ satisfying j^{\/ f{x + h) — \/ f{x) — h ^(x)) dx = o{h'^) 
and j^{i^{x + h) — ipix)) dx = o(l), as well as that \\iJj\\ > 0. 

Note that under this assumptions, the model of i.i.d. observations with 
density f{x + 6) is, in particular, LAN at ^ = with Fisher information 
/ = 4||?/'|p = 4:J^ip'^{x) dx (see, for example, [15l Chapter 2.1]) and so, 
using characteristic functions, we have 

hm Ee /(-) = e'^ 2 ''* a-"" * 

and, more generally, 

lhn(Ee^"'^'^)''''=e<-f)-^^*^ (5) 

for all t e [R. 

Note also, that only the convergence ([5]) will be needed in our consider- 
ations. So, one can rather assume it directly, or make any other regularity 
assumptions sufficient for it as, for example, Hajek's conditions: / is differ- 
entiable and the Fisher information I = J^^ /~^(x)(/'(x)) dx is finite and 
strictly positive (see, for example, [151 Chapter 2.2]). 

Note finally, that in the Gaussian case the regularity assumptions clearly 
hold and we have 1=1. 

The asymptotics 7 ^^ 

Let us consider the process X^j{y) = Z^j{y/I'j'^), y G R, where Z^j is 
defined by (^. Note that 

lRyXyjiy)dy _ ^ 2 



/k Xjjiy) dy 



irc.j 



inil z : X^j{z) = supX^j(y) [ = I-f^i 



2/eK 



and 






+ 



where the random variables C7,/ and ^^j are defined by ([3]). Remind also 
the process Zq on IR defined by ([T]) and the random variables Co and ^0 
defined by dH). Recall finally the quantities B^j = EC^j, M^j = ^{^"jf, 
E^j = B^j/M^j, as well as Bq = ECo^ = 16C(3), Mq = E^i = 26 and 
£^0 = Bq/Mq = 8C(3)/13. Now we can state the main result of the present 
paper. 

Theorem 1 The process X^j converges weakly in the space "Dol^oO) +00) to 
the process Zq as 7 — )■ 0. In particular, the random variable I'-y'^Q^j converges 
weakly to the random variable Co o-nd, for any a G [0, 1], the random variable 
^1'^^^ f converges weakly to the random variable ^o- Moreover, for any k > 
we have 

JV^EC^j^ECo and JV'' E(e"j)'= ^ E^q • 
In particular, P-f^B^j -> 16C(3), I^^M^j -^ 26 and E^j -^ 8C(3)/13. 

The results concerning the random variable C7,/ are direct consequence 
of [ini Theorem 1.10.2] and the following three lemmas. 

Lemma 2 The finite- dimensional distributions of the process X^j converge 
to those of Zq as 7 — )• 0. 



Lemma 3 For any C > 1/4 we have 



E 



2 

^ c\yi -1/2I 



for all sufficiently small 7 and all yi,y2 € R. 

Lemma 4 For any c G ] , 1/8 [ we have 

EX;/;(y)^exp(-c|y|) 

for all sufficiently small 7 and all y ^ R. 

Note that these lemmas are not sufficient to establish the weak conver- 
gence of the process X^j in the space PqI— 00, +00) and the results con- 
cerning the random variable ^"^. However, the increments of the process 
InX^j being independent, the convergence of its restrictions (and hence of 
those of X^j) on finite intervals [A, B] C R (that is, convergence in the 
Skorohod space V[A, B] of functions on [A, B] without discontinuities of the 
second kind) follows from p!T| Theorem 6.5.5], Lemma |2] and the following 
lemma. 



Lemma 5 For any 6 > we have 

lim lim sup P< \\nX^j{yi) —\nXyj{y2)\ > 6\ =0. 



\yi-y2\<h 



Now, Theorem [T] follows from the following estimate on the tails of the 
process X^j by standard argument (see, for example, jT5|). 

Lemma 6 For any 6 G ] , 1/12 [ we have 



bA [ ^ A „-bA 



P supX,j(|/)>e-''^^^4e- 
l\y\>A ) 

for all sufficiently small 7 and all A > 0. 

The proofs of all these lemmas will be given in Section |3l 

The asymptotics 7 — >^ +00 

Now let us discuss the second possible asymptotics 7 — ?■ +00. It can be shown 
that in this case, the process Z^j converges weakly in the space PqI^oo, +00) 
to the process Zoo{x) = l{^ri<x<T}, x E R, where rj and r are two independent 
exponential random variables with parameter 1. So, the random variables 
C7,/) ^7 /) ^7 / ^iid ^7,/ converge weakly to the random variables 

_ J^xZoo{x) dx _ T -r] 
°° J^ Zoo{x) dx 2 

^~ = mil z : Zoo{z) = sup Zoo{x) \ = -r], 
^+ = sup] z : ^00(2;) = sup Zoo{x) \ = T 



and 



C = «^oo + (l-a)^i) = (l-«)r-ar7. 



respectively. It can be equally shown that, moreover, for any A; > we 
have 

EC,',^^EC^ and E(e,",^)'= ^ E(0^ 



In particular, denoting B^ = EC^, M^ = E(^^)2 and E^ = B^/M^, we 
finally have 



' T — VX"^ 1 

B^j -^ B^ = E[ -^—J = 2 ' 



M:;j^MZ = E{il-a)T-avY = Q(^a-^^ +i 



(6) 



and 



Kf-^E:^ = —. TT^-- (7) 



12 ( 



a- I) 



Let us note that these convergences are natural, since the process Zoo can 
be considered as a particular case of the process Z^j with 7 = +00 under 
natural conventions f{e ± 00) = and InO = —00. 

Note also, that Z^d is the limiting likelihood ratio process in the problem 
of estimating the parameter 6 by i.i.d. uniform observations on [9, ^ + 1]. So, 
in this problem, the variables Coo and ^^ are the limiting distributions of the 
Bayesian estimators and of the appropriately chosen maximum likelihood 
estimator, respectively, while -Boo and M^ are the limiting mean squared 
errors of these estimators and, the Bayesian estimators being asymptotically 
efficient, E^ is the asymptotic relative efficiency of this maximum likelihood 
estimator. 

Finally observe, that the formulae (|6]) and ([7]) clearly imply that in the 
latter problem (as well as in any problem having Zoo as limiting likelihood 
ratio) the best choice of the maximum likelihood estimator is a = 1/2, and 
that the so chosen maximum likelihood estimator is asymptotically efficient. 
This choice was also suggested for TAR model (which has limiting likelihood 
ratio Z^) by Chan and Kutoyants in [5]. For large values of 7 this suggestion 
is confirmed by our asymptotic results. However, we see that for small values 
of 7 the choice of a will not be so important, since the limits in Theorem [1] 
do not depend on a. 

Numerical simulations 

Here we present some numerical simulations (in the Gaussian case) of the 
quantities B^, M" and E^ for 7 G ]0, oo[. Besides giving approximate values 
of these quantities, the simulation results illustrate both the asymptotics 

B^ = ^ + o{l-'), M° = ^ + o(7-^) and E^ ^ Eo as 7^0, 

9 



with Bo = 16C(3) ^ 19.2329, Mq = 26 and Eq = 8C(3)/13 ^ 0.7397, and 

B^^B^, M^^M^ and E^ ^ E^ as 7 -> oo, 

with^oo = 0.5, M° = 6 (a -0.5)2 + 0.5 and E^ = l/(l2 (a-0.5)2 + l). 

First, we simulate the events a;||^,x^, ... of the Poisson process 11+ and 
the events x^,x^,... of the Poisson process n_ (both of intensity l), as 
well as the partial sums S^, S2, ... of the i.i.d. A/'(0, 1) sequence ef, e^, . . . 
and the partial sums Si , S2, ... of the i.i.d. Af{0, 1) sequence £]", e^, . . . . For 
convenience we also put Xq = Xq = Sq = Sq = 0. 

Then we calculate 



c 



Jr ^-yi^) dx 



i=0 i=0 

00 00 



i=0 i=0 



C = inf < z : Z^{z) = sup Zj{x) \ 



— x^^, otherwise. 



xgR " 'J \ —xj , otherwise. 



e+ = supjz : Z,{z) = sup Z,{x)} - ^ ''^+^' " ^k ^ ^i ^ 



and 



c = ac + (i-«)e 



where 



7 ' 



k = argmax 5"^^ and i = argmax S^ 



and we use the values 1/2, 1/4 and for a. Note that in this Gaussian case 
(due to the symmetry of the process Z^) the random variable ^3;~" has the 
same law as the variable —C,^, that's why we use for a only values less or 
equal than 1/2. 

Finally, repeating these simulations 10''' times (for each value of 7), we 
approximate B^ = E(^ and M" = E(^")2 by the empirical second moments, 
and E^ = B^/M^ by their ratio. 

The results of the numerical simulations are presented in Figures [IH3l 
The 7 — )■ asymptotics of the limiting mean squared errors is illustrated 

10 



in Figure m where we rather plotted the functions 7^-B^ and 7^M° making 
apparent the constants Bq ^ 19.2329 and Mq = 26. One can observe here 
that the choice a = 1/2 is the best one, though its advantage diminishes as 7 
approaches and seems neghgible for 7 < 1. 
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Figure 1: 7'^-B'y and 7^M" (7 — )■ asymptotics) 

In Figure [2] we illustrate the 7 — ?■ 00 asymptotics of the limiting mean 
squared errors by plotting the functions B^ and M" themselves. Here the 
advantage of the choice a = 1/2 is obvious, and one can observe that for 
7 > 5 this choice makes negligible the loss of efficiency resulting from the use 
of the maximum likelihood estimator instead of the asymptotically efficient 
Bayesian estimators. 
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Figure 2: B^ and M" (7 — )■ 00 asymptotics) 
Finally, in Figure |3] we illustrate the behavior both at and at cxd of 
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the asymptotic relative efficiency of the maximum hkehhood estimators by 
plotting the functions E^. All the observations made above can be once 
more noticed in this figure. Note also that as 7 increases from to 00, the 
asymptotic relative efficiency seems ffist to decrease from Eq ^ 0.7397 for 
all the maximum likelihood estimators, before increasing back to E^ for the 
maximum likelihood estimators with a close to the optimal value 1/2. 
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Figure 3: -E" (both asymptotics) 



3 Proofs of the lemmas 

For the sake of clarity, for each lemma we will first give the proof in the 
particular Gaussian case (in which it is more explicit) and then explain how 
it can be extended to the general one. 

Proof of Lemma [2] 

Note that the restrictions of the process InX^(y) = lnZ^(?//7^), y G R, (as 
well as those of the process In Zq) on [R_(_ and on IR_ are mutually indepen- 
dent processes with stationary and independent increments. So, to obtain 
the convergence of all the finite-dimensional distributions, it is sufficient to 
show the convergence of one-dimensional distributions only, that is, the weak 
convergence of lnX^(?/) to 



\iiZ^{y) = W{y) 



^-AT 



\V\ I I 
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for all y E R. Moreover, these processes being symmetric, it is sufficient to 
consider y E R+ only. 

The characteristic function f-yit) oi\nX^{y) is 



/ 2 n+{j//72) 

^ A:=l 



where we have denoted ^n+ the a- algebra related to the Poisson process 11+ , 
used the independence of e^ and 11+ and recalled that Ee**^ = e~* /^. 

Then, noting that n+(|//7^) is a Poisson random variable of parameter 
y/7^ with moment generating function Ee*^+*^^/''' •* = exp(-^(e* — 1)), we 

ln^7W = :^(e-^^^-^) - 1) = :^(4(.t + t^) + 0(7^)) 

as 7 — )■ and so, in the Gaussian case Lemma [2] is proved. 
In the general case, proceeding similarly we get 

if^it) = Ee'"'^^--/^^) = Ee =' ^^^ 

= E[(Ee^*^^'^)"'^'^'''^] ^ e<-i)*-^^*^ = Ee^""^o(-) 

by dominated convergence theorem, since 

Ee ^(^) -^ e '^ S'' 2-'* 



by dS]), and 7^ n+(y//7^) converges clearly to y/I in L^ (and hence in prob- 
ability) . 
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Proof of Lemma |4] 

Now we turn to the proof of Lemma H] (we will prove Lemma [3] just after). 
For y > we have 

EX'^/\y) = EE (e-is"-''''^^^-^"+(^/^') | ^n,) 

= Ee"^"+(^/^')+^"+(^/^') = Ee-^"+(^/^') 

The process X^ being symmetric, we have 
EXf(y) = exp(M(e-^ 
for all y G [R and, since 

as 7 — 7- 0, for any c G ]0, 1/8 [ we have EX^ (y) ^ exp(— c|y|) for all 
sufficiently small 7 and all y E R. So, in the Gaussian case Lemma H] is 
proved. 

In the general case, equality (|H]) becomes EX 'r (y) = exp(|y| (/^ — 1)//7^) 
with 

Recall the convergence (^ of characteristic functions and note that /^ are 
the corresponding moment generating functions at point 1/2. The conver- 
gence of these moment generating functions (at any point smaller than 1) 
follows from the fact that for all 7 they are equal 1 at point 1 (which pro- 
vides uniform integrability) . Thus we have L/ — )■ e~^^^, which implies 
(In J^)/72 -^ -J/8, and so (/^ - l)/I-f^ -^ -1/8. 

Proof of Lemma [3] 

First we consider the case 2/1,2/2 ^ 1R+ (say Vi ^ 2/2)- Using (^ and taking 
into account the stationarity and the independence of the increments of the 
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process InX^ on IR+, we can write 

E \X\l^y,) - .Yy2(t,2)|' = E.Y,(i/i) + EA',(t,2) - 2E.Y,"=(i/i).fy'(!/2 

= 2-2EA-,fc)E|J^ 
= 2-2EX},'-'(\yi-y2\) 



^-2 '-\/-' (e-^-l) ^-|2/i-y2| 



The process X^ being symmetric, we have the same result for the case 

yi,y2 e R-. 

Finally, if yiy2 ^ (say y2 ^ ^ ^ Vi) , we have 
E K'Hy,) - Xi/^(j,2)f = 2 - 2EXi/2(;„)EXi/'(jfa) 

^2-2exp(^(e-*-l)+^(e-*-l 

= 2 — 2 exp I ^ — - ( e « — 1 

1 , 

and so, in the Gaussian case we obtain even more than the assertion of 
Lemma O 

In the general case, proceeding similarly we get 

E 
and, since — 2(/^ — l)//7^ — )• 1/4, the proof is concluded. 



^1/2/ X x-1/2/ \\^ „ 1/1— 1/2/ r ix 



Proof of Lemma [5] 

First let 2/1, ?/2 £ IR+ (say yi ^ 2/2) such that /S.= \yi — y2\ < h. Then, noting 
that conditionally to ^ji+ the random variable 

n+(A/72) 2 

lnX,(A) = -7 5^ 4-^n4A/7^) 
ifc=i 

15 



is Gaussian with mean — ^n+(A/7^) and variance 7^n+(A/7^), we get 



^E|lnX,(A)f 



^n. 



lEE((lnX,(A))^ 

7VA A^- 



52 ^ ^ + 4 I y 



r 



1 
1 



((1 + 7V4)A + AV4) 



< ^ (/3(7) /^ + h'/A) 



where /3(7) = 1 + 7^/4 — ?■ 1 as 7 — )■ 0. So, we have 

hm sup p||lnX^(yi)-lnX^(t/2)| >5| ^hm^(/3(7)/i+/iV4) 



'^^^ |j/i-S/2|<?» 



1 fu h' 



and hence 



hm hm sup P< |lnX^(t/i) — \nXj{y2)\ > 5> = 0, 



|yi-?/2|<ft 



where the supremum is taken only over yi,y2 G IR+- 

The process X^ being symmetric, we have the same conclusion with the 
supremum taken over yi,y2 € R-- 

Finally, for yiy2 ^ (say 1/2 ^ ^ yi) such that \yi — y2\ < h, using the 
elementary inequality (a — 6)^ ^ 2(a^ + 6^) we get 

p[\lnX^{y,) -\nX^{y2)\ > 6] ^ ^E\\nX,{y^) -\nX,{y2)\' 



(5^ 
2 

2 



^- E|lnX,(|/i)r + ElnX,(||/2|) 



(/3(7)yi + yiV4 + /3(7)bl + b2|V4) 



< ^1/3(7)/^ + /^V4), 
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which again yields the desired conclusion. So, in the Gaussian case Lemma E] 
is proved. 

Another way to prove this lemma, is to notice first that the weak con- 
vergence of \nX^{y) to \nZo{y) (established in Lemma [2]) is uniform with 
respect to y E K for any compact K C R. Indeed, the uniformity of the 
convergence of the characteristic functions in the proof of Lemma [2] is obvi- 
ous, and so one can apply, for example. Theorem 7 from Appendix I of [IS] . 
whose remaining conditions are easily checked. 

Second, using this uniformity we obtain 

lim sup P< |lnX^(yi) —\n.XJy2)\ > 5) = lim sup P< |lnX-,(y)| > 6) 

= supP{|lnZo(y)| >4 

\y\<h l- -" 

where the supremum is taken over |/i,|/2 G IR such that yiy2 ^ 0, and 

lim sup p||lnX^(yi)-lnX^(y2)| >5| ^2supP||lnZo(y)| >-) 
■^^° \yi-y2\<h *- -" \y\<h ^ ^^ 



where the supremum is taken over yi,y2 G R such that y\y2 ^ 0. 

Finally, reminding that lnZo(|/) ~ 7V(— ||/|/2, |?/|) and denoting $ the 
distribution function of the standard Gaussian law, we get 



\y\ 



\Vh) 



for \y\ < h. The last expression does not depend on y and clearly converges 
to as /i — 7- 0, so the assertion of the lemma follows. 

It remains to observe that this second proof does not use any particularity 
of the process X^ and, hence, is trivially extendable to the general case. 
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Proof of Lemma [6] 

Taking into account the symmetry of the process InX^, as well as the sta- 
tionarity and the independence of its increments on IR_|_, we obtain 

p| sup X^{y) > e-'^A ^ 2p|supX^(y) > e-''A 

{\y\>A J ly>A J 



^2e^^/2EsupXy2(^) 

y>A 



= 2e'^/' EX'/\A) E sup ^^J^ 
^ y>AX:^^\A) 

z>0 

In order to estimate the last factor we write 

n+{^/7') 2 

EsupXV2(^)=EexpUsup|-7 V et-^U+{z/j^' 



(9) 



Eexp - sup (-ly^e 



z>0 

\ \ K = l 

„2 



wy 



Now, let us observe that the random walk Sn = — J2t=i ^fc ' ''^ ^ ^' ^^^ ^^^ 
same law as the restriction on N of a standard Brownian motion W. So, 

E 



supX^/2(z) = Eexp ( - sup {-fW{n) - n-f^/2) 

z>0 \2 neN 

= Eexp I - sup (Vr(n7^) - n7^/2) 

^ E exp ( - sup {W{t) - t/2) J = E exp ( - M 

with an evident notation. It is known that the random variable M is expo- 
nential of parameter 1 (see, for example, [3]) and hence, using its moment 
generating function Ee*^ = (1 — t)~^, we get 

EsupXy2(^) ^2. (10) 



7 

2>0 



Finally, taking 6 G ] , 1/12 [ we have 36/2 G ] , 1/8 [ and, combining 
TOj) and using Lemma HI we finally obtain 



p( sup X^{y) > e-'A ^ 4e'^/2 g^pf-— a) = 4 
[\y\>A J V 2 / 



^-bA 
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for all sufficiently small 7 and all A > 0, which concludes the proof in the 
Gaussian case. 

In the general case the proof is almost the same. Note that we have no 
longer the symmetry of the process ^7,/, so we need to consider the cases 
y > A and y < —A separately. Besides that, the only difference is in the 
derivation of the bound flTO|l . Here we get 



E sup X^^Jiz) = E exp ( i M 



2>0 



where M is the supremum of the random walk Sn = J2t=i -^k, n G N, with 
Xfc = In ^^^^ . Note that 



X. ^/(^ + 7) 



Ee^^ =E' 



fie) 



and so, the cummulant generating function k{t) = ln(Ee*'''"^) of Xi admits 
a strictly positive zero t^ = 1. Hence, by the well-known Cramer-Lundberg 
bound on the tail probabilities of M (see, for example. Theorem 5.1 from 
Chapter XIII of [1]), we have 

P{M>x) ^e-*o^ = e-^ 

for all a; > 0. Finally, denoting F the distribution function of M and using 
this bound we obtain 

Eexp(-Mj = /"e^/^rfF(x) 

r , 1 +°° 1 /■ 

= e"/2(F(x) - 1) - =- e"/2(F(x) - l) dx 

<! + -/" e"^/2 dx = 2, 
2 7,^ 

which concludes the proof. 
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